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Abstract We study the off equilibrium dynamics of a mean field disor- 
dered systems which can be interpreted both as a long range interaction spin 
glass and as a particle in a random potential. The statics of this problem 
is well known and exhibits a low temperature spin glass phase with contin- 
uous replica symmetry breaking. We study the equations of off equilibrium 
dynamics with analytical and numerical methods. In the spin glass phase, 
we find that the usual equilibrium dynamics (observed when the observation 
time is much smaller than the waiting time) coexists with an aging regime. 
In this aging regime, we propose a solution implying a hierarchy of crossovers 
between the observation time and the waiting time. 
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1 Introduction 



A lot of efforts have been devoted in the last fifteen years to the study of 
equilibrium static and dynamic properties of spin glasses |TJ, Ej|. Com- 
paratively, the off equilibrium dynamical effects have received less attention. 
The recent years have seen a renewal of interest for this OED. One reason is 
experimental. While it is clear that many experimental observations are in- 
herently dynamical effects, the status of the off equilibrium dynamical effects 
have turned recently from that of an annoying perturbance to that of a very 
powerful probe. Some of the most interesting recent experimental findings 
in spin glasses, like the slow relaxation of the thermoremanent magnetiza- 
tion, aging, and memory effects during temperature cycling experiments, are 
inherently out of equilibrium phenomena |4], || ^| [7|. Several phenomeno- 
logical models of these effects have already been proposed, based on ideas 
of droplets |R |J or phase space traps with a broad distribution of trapping 
times ||10|| . The second origin of this upsurge of interest comes from the theo- 
retical side. Prompted by the experimental observations, it has been realized 
recently that some microscopic analytical approach to these problems is pos- 
sible, and that the off equilibrium nature of the dynamics might even cure 
some old problems of the dynamical approach. The first works on spin glass 
dynamics, following the idea that the use of a dynamical generating func- 



tional could be an alternative to the introduction of replicas |TT[ , focused on 



the ED fL2| , |T3|j . Early attempts to model some aspects of the OED along 
these same lines have concentrated on the mean field theory of spin glasses 
close to the critical temperature, taking into account explicitely the changes 
in external parameters like temperature or magnetic field [14, 15]. More re- 



cently, it has been observed that these effects can be studied without any 
reference to time variation of the external parameters, but by keeping into 
account the existence of an initial time for the dynamics (corresponding to 
the quench into the spin glass phase in the experiments), and the existence 
of a finite waiting time |J, H3> HI HH HI- 

In this paper we study the off equilibrium dynamics (OED) through a 
microscopic approach along the lines above. We consider the problem of an 
oriented D dimensional manifold embedded in a D+N dimensional space, 
in presence of a random potential. This is a very interesting and general 
problem [^TJ which is connected to interface pinning by impurities , directed 
polymers in disordered media, vortex pinning in high temperature supercon- 



ductors pi EBJ, and also, after various mappings, to growth phenomena p3 



or turbulence [p5| . We shall work in the limit of an infinite dimensional em- 
bedding space (N oo). This limit has two major advantages. It allows for 
the derivation of exact integrodifferential equations for the correlation and 
response functions. Also in this limit the static properties have been studied 
in details using the replica method, and it has been shown that a full hierar- 
chical replica symmetry breaking (r.s.b.) is needed in order to describe the 
system f26| . 



Our work has two aspects. One is an analytic study of the OED equations 
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at large times, which shows a possible family of solutions related to the static 
(r.s.b.) solution. The other one is the numerical solution of these equations. 
This numerical solution is in fact limited to the D = version of the general 
random manifold problem. This is nothing but the "toy model" of a single 
particle in N dimensions, submitted to a potential which is the sum of a 
quadratic well and a Brownian process [^, |28], |30], 0. In the large N 
limit, this model can be interpreted as a long range spin glass model, and 
we shall show that many interesting aspects of the dynamics are kept by this 
toy model, as is true for the statics [f2(], [2l| . A brief account of our work has 
appeared recently |3l] . 

The equilibrium Langevin dynamics (ED) of the manifolds in the large N 
limit has been worked out by Kinzelbach and Horner in two interesting recent 
papers [|3^, |33|, following the general strategy used by Sompolinsky and Zip- 
pelius [[12|, |13| in spin glasses. We shall basically reconsider their approach, 
using the OED corresponding to a finite waiting time, in the spirit of the 
recent work by Cugliandolo and Kurchan on the spherical spin glass with p- 
spin interactions |l7j . Technically the difference is that in the off-equilibrium 
dynamics the dynamical evolution starts at a time to = 0. Therefore the cor- 
relation function C(t,if) and the response function r(t,t') depend explicitely 
on both t and t'. In the equilibrium dynamics the time to is sent to — oo, and 
the correlation and response become functions of the differences between t 
and t': C eq (t — t') and r eq (t — t'). 

As we shall see there are many formal similarities between these two 
dynamics, together with formal similarities with the static r.s.b. solution. 
However one should keep in mind that the physical contents of these two 
approaches are actually quite different. In ED, C eq and r eq satisfy coupled 
equations which depend explicitely on an anomaly of the response occuring 
on infinite time scales. One must assume the existence of a regularization 
of these diverging times by considering for instance a system with a finite 
number of degrees of freedom. The " dynamical" equations on diverging time 
scales turn out to be identical to the static (r.s.b.) equations of the replica 
method. It is important to notice that this "dynamics" on diverging time 
scales is not really a dynamical solution (for instance it is invariant under 
arbitrary reparametrizations of time). In our opinion this equilibrium "dy- 
namics", considered on diverging time scales, rather gives an "intuitive" and 



appealing description of the strange algebra of the replica method |34 



In contrast, in OED, C(t, t') and r(t, t') obey causal equations which have 
a unique solution (for instance, for t > t', dC(t,t')/dt depends only on C 
and r evaluated at times smaller than t.) ||17|| . One can work directly with an 
infinite system, and there is no need to introduce diverging time scales. An 
important point is that the introduction of a finite waiting time provides a 
natural regularization: as we shall see, the roles of the diverging time scales 
are then played by some functions (e.g. powers) of the waiting time. 

It is not easy to get some analytical information on the correlation and 
response in OED. However, as they obey causal equations, one can solve 
them numerically in a rather straightforward way. Our work is based on a 
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detailed numerical solution of these OED equations of the toy model. We 
shall divide our results into two groups. One which refers to the asymptotic 
regime (t — t' finite), the other refers to the non asymptotic regime. 

In the asymptotic regime, we shall present hereafter numerical evidence 
that: 1) There exists a limiting response function r as (r) = Um tw _ 00 r(t w + 
r, t w ); 2) This function is the same as that derived in ED ||32|| , with a certain 
condition of criticality of the anomalous response coming from diverging time 
scales; 3) Similar results hold for the correlation. In particular, the values of 
C as (0) and C as (r — > oo) agree with the results for the statics from the full 
r.s.b. solution; 4) The energy E{r) also converges to its static r.s.b. value at 
large r. 

These results on the asymptotic behaviour provide an independent con- 
firmation of both the static r.s.b. approach, as well as the usual equilibrium 
dynamics on finite time scales. In order to understand the origin of these 
results, and simultaneously to study the aging effects, one needs a careful 
study of the correlation and response for finite waiting times. Here we shall 
point out a few effects: 1) The very fact that one recovers the static r.s.b. 
results in the spin glass phase implies that there must be aging effects (in 
the sense that, at an arbitrary large time t, some perturbation of the system 
at times t' < t has a relevant effect, even when t — t' is very large). These 
aging effects are also seen in our numerical studies on the (short) time scales 
we can achieve. 2) It is possible to find a family of approximate solutions of 
dynamical equations at large times. These solutions are technically related 
to the solutions of the dynamics on diverging time scales found in [p3| , but 
the role of the " diverging time scales" is now played by some functions of the 
waiting times (like for instance t^). 

In the next section we introduce the model and write down the dynamical 
equations in the large N limit. In sect. 3 we review the static results obtained 
with the replica method. Sect. 4 presents an analytic study of the asymptotic 
regime, which is compared to the numerical integration of the equations 
in sect. 5. Sect. 6 deals with the aging regime. Some perspectives are 
summarized in sect. 7. 

2 The model 

The manifold is decribed by a N component field (j) a {x), where a G 1, ...N. 
The energy is: 

ff = / cpar (^ 1 (^) a+ 2 E/* + f*°v(*M*))\ (i) 

where V is a gaussian random potential, the correlations of which are taken 
as: 

V(x, cJ>)V(x>, cj>') = -NS(x - x')f ( {<t> ~f )2 ) , (2) 
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with: 

We assume a Langevin dynamics: 

d<j) Q (x,t) dH 



, +T] a (x,t), (4) 

0(j) a {x,t) 

where 77 is a white noise with < r] a (x,t)r) a i(x' ,t') >= 2T5 aa /8(x — x')8(t — t'). 
This dynamics can be studied by usual field theoretical techniques |12| which 



are reviewed, in the present context, in p2| . We present an alternative 
derivation of the equations, based on the cavity method []T|, in the appendix. 
For the OED, we find that, in the large N limit, the correlation: 

C(x, t; x', f ) =< - t)<p a {x', f) > (5) 

and the response: 

r(x, t; x', f ) =< - V f^fr*) > (6) 
satisfy the following equations: For t > t': 

5 m(t, s; x)(r(x, t; a/, t')—r(x, s; 

(7) 

— ^ — - — - = (A x — fi)C(x,t; x' ,t') + 2 [ ds w(t,s;x) r(x,t';x',s) 

at Jo 

+ 



dv(x t' x* i') ft 

- (A x —/j,)r(x, t; x', t')+ / ds m(t, s; x)(r(x, t; x', t')—r(x, s; x', t')) , 



at jo 



/ dsm(t,s;x) (C(x, t; x' , t') — Cix, s; x', t')) , (8) 
Jo 

(A,. — n)C(x, t; x' , t) + 2 ds w{t, s; x) r{x, t'; x\ s) 



and: 

1 dC(x, t; x', t) 

2 Jt 

+ / ds m(t, s; x) (C(x, t; x', t) — CCx, s; x', t)) + T . (9) 
Jo 

In these equations, we have used the following notations: 

w {t, t'; x) = f'(b(t, t'; x)), m(t, t', x) = 4/"(6(t, t'; x))r(x, t; x, t') 
b(t,t';x) = C(x, t; x, t) + C(x, t'; x, t') - 2C(x, t; x, t') . (10) 

This set of equation is causal. The boundary conditions on r are r(x, t, x', t~) = 
5(x — x'). Given an initial condition C(x, 0, x', 0), it has a unique solution. 

In the following we shall concentrate on the toy model, D = 0, where 
the space dependence in these equations is dropped. We note that in this 
limit the model, described by the simple Hamiltonian H = (l/2)fiJ2 a ( f ) a + 
V((f>i, ...,<fi N ), admits another interesting interpretation as a spin-glass. The 
components cj) a can be thought as soft spins in a quadratic well, interacting 
via the random potential V. In particular, in its spherical version, i.e. taking 
the constraint 4 Y, a 4>a = 1; it is possible to choose the values of 6 and 7 



such as to obtain the spherical p-spin model considered in |35|, 17 
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3 Static replica solution 



We briefly review here the results of the static r.s.b. approach for the toy- 
model (D — 0), concentrating on quantities that we will study in dynamics. 
We keep to the case of "long range" disorder correlation 7 < 1 where the 
replica symmetry breaking is of the full continuous kind. The equilibrium 



statistical mechanics of the model has been studied in [gg, |29[ for the special 
case 6 = 0. In dynamics a non-zero 9 is needed to regularize the correlations 
of the potential at short distance. The results of generalize as follows. 

At high temperature the system is ergodic and replica symmetric, and the 
equilibrium is characterized by the correlations 

F?»-. = « = ^ + ^ + y)" 7 

1 1 9T 

where by angular brackets we have denoted the thermal average and by an 
overline the disorder average. The energy is given by 

E = ^q + ^[f(0)-f(2(q-q))] (12) 
At a critical temperature T c , 

r -f(- e + C) ( ^ (13) 

there is a phase transition and replica symmetry is broken. The thermo- 
dynamics of the system is fully specified by q = jr J2 a ('Pa) an< l by a func- 
tion q(u), u G [0,1]. Standard arguments from the mean field theory of 
spin glasses , imply breaking of ergodicity and the existence of many pure 
states, whose correlations are characterized by a non trivial P(q) defined as 
the overlap distribution for two copies of the system with identical realization 
of the random potential V: 



p (q) = < jj E K<t>^a - q) >ams = ^ (14) 

where u(q) is the inverse function of q(u). The order parameter function q(u) 
is: 

!q u<u 
^+|-K^^) 2/(7 ~ 1) u <u< Ul (15) 
qi u\ < u < 1 

where 

,2 \ - V(i+7) 

qo 
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Wo = T(l + 7 )( / i) (1 -^ (1+ ^(2 7 )- 1/(1+ ^ 
ui = ^=(l + 7)(^ + 2(g-g 1 )) ( ^ 1)/2 



? = f (16) 



27 \27 

and g — gi is the solution of the equation 

T 



~q- qi = ^={d + 2{q- qi )f l+ ^\ (17) 



From the knowledge of q and g(w) all the physical quantities at equilibrium 
can be calculated, for example the energy is: 

E=^q + ^[f(0)- J Q 1 duf(2(q-q(u)))] (18) 



The results presented here for the q(u) have also been obtained in |33| in the 



ED approach with Sompolinsky ansatz, which, as we have already remarked, 
reproduces the algebra of the r.s.b. approach. 

4 Analytic study of the asymptotic regime 

The scope of this section is to study the behaviour of the solution of the 
dynamical equations (0,§|,0) in the "asymptotic" limit. This limit is defined 
as t = t w + r, t' = t w , with t w — >• 00 while r is kept fixed. For the sake of 
the simplicity of the presentation, we shall present the whole analysis in the 
case D = 0. The generalization of the analytic results to higher dimensional 
problems is straightforward. We rewrite here, just for graphical transparency, 
the dynamical equations (|7|||I1D for D = 0. 



dr{t,t ; ) 

dt 
dC(t,t') 



-/ir(t, t') + f ds m(t, s)(r(t, f) - r(s, t')) 







-uC(t, t')+2 / ds w(t, s) r(t', s) 
at Jo 



+ I ds m(t,s) {C{t,t') -C{s,t')) , 







ldC(t,t) 



-fiCCt, t) + 2 ds w(t, s) r(t, s) 
Jo 

+ f dsm{t,s) (C(t,t)-C(s,t)) +T, (19) 

" 



2 dt n v ' Jo 

rt 



with 



w(t,t') = f(b(t,t')), m(t,t') = 4f"(b(t,t'))r(t,t') 
b(t,t') = C(t,t) + C(t',t')-2C(t,t') . (20) 
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For future reference we also give the formula for the energy: 

E(t) = %C(t, t) - 2 f ds f'(b(t, s))r(t, s) (21) 
2 Jo 

Let us make the reasonable assumption, supported by the numerical inte- 
gration below, of the existence of an asymptotic regime for t, t f — > oo keeping 
t = t — t' finite. Namely we will suppose the existence of the two limiting 
functions 

r as (r) = lim r(t' + r,t') (22) 

r — >oo 

C as (r) = lim C(t' + r,t'). (23) 

t — >oc 

Taking the limit of the dynamical equations ( |19D in the asymptotic regime, 
we get the non causal equations 



db n 



dr 



dr as 
dr 



+ M as + M)b as (r) - [ T dr' m as {r - t') b as {r') + 2T 
Jo 

poo 

/ dr' [m as (r + r') - m as (T f )} b as (r') + 4 [w as (T + r) - w as (T f )] r as (r'), 
Jo 

+ M as + M)r as (r) - f dr' m as (r - r') r as {r') , (24) 



I / | POO POO 

Ca S (0) = =[T + - ds m as (s) b as (s) + 2/ ds w as (s) r as (s] 

j2 — M \ I Jo Jo 

where for convenience we have written the equation for the correlation in 
terms of b as {r) = 2[C as (0) — C as (r)} instead of C as (r) and we have denoted 

POO 

M as = / dr m as {r), (25) 



M = lim /* ds m(t, s) - M as . (26) 



The functions m as and w as are defined in a way similar to m and w in (]20|) , 
but using the asymptotic correlation and response. 

The term M, which we will call "anomaly" in the following, is the term 
which couples the asymptotic time regime (r = t — t' finite) to the non 
asymptotic ones. The equations (^) are identical to those which appear in 
the ED studied by Kinzelbach and Horner |33] . The only difference lies in the 
interpretation of the anomaly: In ED it is supposed to be due to the response 
of the system to some perturbations taking place on infinite time scales. This 
is not easy to define, since the regularization of these diverging time scales 
by using a finite volume system in principle invalidates the derivation of the 
dynamical equations (|25|). The definition (p6|) of the anomaly in OED is very 
clear. 

Let us now briefly quote the following results from the study of ED in [33 



One may search a solution of the asymptotic equations ( |2"5| ) which satisfies 
the fluctuation-dissipation-theorem (f.d.t.): 

Tr as (r) = ~^C as {r) = \^b as {r). (27) 
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Assuming the f.d.t., the asymptotic equations simplify to: 



d() / roc \ rr 

-j J - = 2T-6 os (r) l/i-M-J ds m as {s) J + J ds m as (s){b as (r) -b as {s)) 

(28) 

The condition for the existence of a monotonous solution b(t) to this equation 
is that 

2T 

b as (oo) = == < b m , (29) 

/i — M 

where b m is the point where the function of b: T/b — f'{b)/T is minimal. 
There are two regimes: at temperatures above the critical temperature T c 
which equals the value (^) computed within the static approach, there exists 
a solution when the anomaly M is zero. This solution agrees with the static 
replica symmetric results (|TTD: 

2T 

Moo) = — = 2{q-q), C as (0) = q , (30) 

At low temperatures, T < T c , there is no solution satisfying the f.d.t. relation 
if M = 0. For such a solution to exist one needs a non zero anomaly: 
M < /i — 2T/b m < 0. The special choice (named "postulate of marginal 
stability" in of the anomaly: 

M = /i - 2T/b m (31) 

leads to an asymptotic correlation 6 as (oo) = b m , which is equal to the static 
result: 2(q — q{) computed within the static approach with r.s.b. fllTD. Sim- 
ilarly, one gets C as (0) = q 

We can summarize this discussion about the asymptotic dynamics in the 
low temperature phase as follows: In view of the static analysis, and its 
interpretation in terms of ergodicity breaking, it is reasonable to assume 
the existence of an asymptotic regime, obeying the f.d.t., and such that the 
two following static correlations are recovered: C as (0) = q, C as (oo) = q — q\. 
However for such a regime to exist one needs a non zero value of the anomaly. 
In the next section we present some numerical results which confirm the 
validity of these assumptions, in section 6 we study the implications of the 
existence of an anomaly in terms of aging. 



5 Numerical study of the asymptotic regime 

While the set of assumptions which have been put forward at the end of 
the previous section look very reasonable, they still deserve a confirmation. 
(In fact some models have been found, such as the spherical spin glass with 
p(> 3) spin interactions, where even the values of the critical temperatures 



found in the static and dynamic approaches are different [17], |35fl . It 
is believed that this effect is related to the fact that the replica symmetry 
breaking is first order in these models.) If these assumptions are correct, it 
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means that the system of causal first order equations (|7|, |) contains the static 
solution with full replica symmetry breaking, which is in itself an interesting 
observation. 

In this section we present a numerical study of the dynamical equations 
([19]). Our aim is to study the low temperature phase of the model comparing 
the result of the integration with the static solution and the asymptotics of 
the previous section. The values of the parameters appearing in the Hamil- 
tonian have been chosen equal to 7 = 1/2, \i — 1/8, 9 — 5. With this choice 
the critical temperature is T c = .658, and for T < T c the static correlations 
take the value q = 21.5 

The discretization of (|T9|) was chosen to be the simple one induced by the 
discretization of the Langevin equation (Q) with the Ito convention. We have 
solved the discrete equations with time steps 4h, 2h, and h, and extrapolated 
the correlation and response to h = by a second degree polynomial, h was 
chosen in such a way that this extrapolation does not differ too much from 
the linear extrapolation of the data at 2h and h. In this way with h = .3 
we where able to reach times of the order of 1000. We also performed the 
integration of the equation for longer times for some particular value of h, 
as we will specify in the following. In most of the simulation the initial 
condition C(0, 0) = 21.5 was taken. We have checked that the dynamics in 
the asymptotic region does not depend on this choice. 

We have integrated the system fllTf ) for T = .5 and T = .2. A run was 
also performed at T = 3 > T c . With this last run we checked that in the 
high temperature phase the OED simply corresponds to the relaxation into 
the unique equilibrium state described by the r.s. statics. Coherently we 
find that C(t,t) tends exponentially to its r.s. value q rs = 32.8, and the 
energy to E rs = 0.368. In the low temperature phase the situation changes. 
The asymptotic extrapolation for C(t, t) and E(t) become incompatible with 
the r.s. values. As a first approximation, the behaviour of the equal time 
correlations C(t, t) is compatible with a power law approach to its asymptotic 
value (with an exponent, deduced from the behaviour of dC(t,t)/dt, equal 
to —.73 ± .05) |3~lfl . When one uses this power law fit in order to extrapolate 
C(t,t) to infinite t, it yields the result 21.4 ± .1 which is in agreement with 
the r.s.b. prediction 21.5. For lower temperatures this procedure is less 
precise, and there are clearly corrections to the simple power law behaviour of 
dC(t,t)/dt. Better estimates for the asymptote are obtained fitting the time 
derivatives of C(t, t) and E(t) with functions depending on three parameters: 

h{t) = ai r a2 (i + |) 

f 2 (t) = a 1 r^(log(t))^(l-a 2 + i ^). (32) 

In the time window we reach, these two fits give comparable errors, but also 
comparable estimates for the asymptote (after integration of the fits). For 
instance we show in Fig. la an estimate of the large time limit , Coo, of the au- 
tocorrelation C(t,t), from the numerical solution of the dynamical equations 
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with a grid size h = 1.2. The derivative dC(t,t)/dt has been fitted to the 
function f 2 . For each time t, is approximated by C(t, t) plus the integral 
of the fit of the derivative. The plot gives C(t, t)+ J t °° f^it') dt' versus the time 
t. Fig. lb shows that the effect of the interpolation at h — become small at 
large time. Altogether this procedure gives ~ 21.49, with an error, due 
to the fit, the extrapolations, which we estimate subjectively to ±.05. This 
is quite compatible with the analytical result from r.s.b., = q = 21.5. In 
Fig. 2 we give the analogous plots for the energy. The correction due to the 
finite grid size do not vanish at long times and must be incorporated. We get 
as a final result: = —1.366 ± .02, in very good agreement with the r.s.b. 
computation: = —1.3660. Similar results can be found at a temperature 
T = .2. Probably the best evidence for the convergence of C{t,t) to q is 
obtained considering the quantity 

A(t) = q(l-r(t,0))-C(t,t). (33) 

and observing that r(t, 0), the response at time t to a change in the field at 
time zero, should tend to zero at large time. So if C(t, t) converges to q, A(t) 
must go to at large times. In Fig. 3 A(t), as well as B(t) = q — C(t,t) are 
plotted on a log-log scale for T=.2. A pure power law fit gives: 

A(oo) = .04 

B(oo) = .3, (34) 

the quality of this two parameter fit on A is comparable with the ones we 
had on C with logarithmic or power law corrections. 

Let us now turn to the study of the asymptotic functions b as and r as . In 
Fig. 4a we plot for T = .5 the response r(t w + r,t w ) versus r for various 
values of the waiting time t w . We also give the result r as (r) of a 3 parameter 
power law extrapolation of these data at t w = oo. The same is done in Fig. 4b 
for the correlation b(t w + r,t w ) = C(t w + r,t w + r) + C(t w ,t w ) — 2C(t w + 
T,t w ). According to the statics, the correlation should go to limr^oobasir) = 
2(<7 — qi) = 6.068. It is possible to see directly that the data is compatible 
with this asymptota, with a power law approach. However, in view of the 
relatively short times r accessible here (keeping r « t w ), we prefer to 
use a different approach which is the comparison to an analytic study of 
the asymptotic equations. In Fig. 4 the limiting functions obtained from a 
power law interpolation are compared to those obtained from the numerical 
integration of the asymptotic equations (|25|) with the anomaly set to its 
"marginal" value (PTj). The agreement is very good. This confirms that the 
asymptotic dynamics coincides with the ED on finite timescales, and agrees 
with the static r.s.b. results. 

6 The non asymptotic regime: aging 

We now turn to the non asymptotic times. From the previous sections we 
know that there exists a non zero "anomaly". This means that the decay 
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of the response r(t, s) at large t — s is slow. More precisely, it implies that 
the integrated response at a large time t, J*q r(i, t — r)dr, receives some finite 
contributions from time differences r which diverge when t goes to infin- 
ity. We define such a situation as a situation of aging. This definition is 
compatible with the ones used so far. It basically means that even at large 
times the physics of the system depends on its previous history. Besides the 
usual asymptotic regime t — > oo, t' — > oo, t — t' finite, there exist other 
" crossover regimes" , in which the limit t, t' — > oo is taken in a different way. 
The asymptotic regime cannot be decoupled from these other regimes. 

We now propose a solution of the dynamical equations, giving the correct 
result for the anomaly, in the non asymptotic regime. Basically we propose a 
reformulation of the Sompolinsky Ansatz [13|, [33j in the context of OED. The 



main difference is that here we do not impose temporal homogeinity in the 
equations ab initio. The diverging time scales of Sompolinsky's approach, 
needed for the system to cross the diverging barriers, are here substituted 
by some function of the waiting time t w , which provides a natural cut-off for 
the theory. A simple version of this scenario, including one single crossover 
domain (corresponding to a single step of r.s.b.), had been found by Cuglian- 
dolo and Kurchan in the spherical p-spin model |[L7|| . Recently they have also 
proposed a similar scenario for the OED of the Sherrington Kirpatrick model 
close to its critical temperature fl3~?| . Let us perform the limit t, t' — > oo by di- 
viding the octant t' < t into non-overlapping crossover domains. A crossover 
domain V u is defined, using an increasing function h u (t), as the set of times 
t, t' which are both large, but keeping the ratio h u (t') / h u (t) = exp(-r) fixed, 
with r e]0, oo[.[] Suppose that in the crossover domain T> u one has: 

b(t, t>) = b u (r) , r(t, t>) = d H ^f )] f u {r) . (35) 

Then the contribution to the anomaly J ' ds m(t, s) from all the times s such 
that s and t are in T> u is finite and equal to 

/ dr4f"{b u {r))r u {r) (36) 
Jo 

which is independent on the function h u . 

In a simple problem like for instance the high temperature phase, there 
should exist a single crossover domain, the asymptotic one defined by h(t) = 
e*. In a glass phase, we can have a relatively simple scenario in which there 
exists, beside the asymptotic domain, another one defined by some other 
function h{t). Such a case (with h{t) = t) has been found recently [[l? 



But one can also have some systems with many crossover domains. The 
condition we impose is that they do not overlap. We can index them by a 



2 The index u of the domains should at first be taken as a discrete variable, in a 
procedure analogous to that of statics in which one considers first a finite number of r.s.b. 
and then passes to the continuum limit. This is familiar to the reader both from the static 
r.s.b. approach and from the ED, and it will be not repeted here. We just mention that 
u will turn out to be a continuous variable in the interval [0,1]. 
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parameter u such that, if w < u < v and the points (t, t') belong to V u , then 
h v {t') I h v {i) = and h w (t')/h w (t) = 1. A possible choice leading to such a 
behaviour would be for instance h u {t) = exp(t u ). With this choice the points 
(t, t') belong to V u when t' = t - t^~ u h/u. 

The alert reader will have recognised in this scenario a hierarchical stuc- 
ture which is reminiscent of the ultrametricity assumption underlying both 
the statics and the equilibrium dynamics ||38|| . We have here a hierarchy of 



time crossovers. Considering three times t" < t' < t, one sees that, if (t, t') 
belongs to the crossover domain V u and (t',t") belongs to V v , then (t,t") 
belongs to V in f( u ^, which is an ultrametric inequality, and obviously implies 
ultrametric relations for the corresponding correlation functions. 

The dynamical equations can be solved within this scenario because one 
can forget the time derivatives in the dynamical equations. The existence of 
an asymptotic regime in which lim T ^oo dC as (r) / dr = 0, implies that in the 
crossover regimes dC Q t f - — ► while dr ^f tends to zero more rapidly then 
r(t,t'). The l.h.s. of ( |T9"D can be neglected in this situation and the problem 
becomes invariant under the family of transformations 

C(M') -> C(h(t),h(t')) 

r(t,t') - ^§p-r(h(t),h(t')) (37) 

for any monotonically increasing function of time h(t). Any non trivial so- 
lution will break this invariance, consequently from a given solution we can 
generate a whole "orbit" of equivalent ones just reparametrizing the time. As 
we have already remarked, the solution of flTPD is unique at any finite times 
t, t'. The appearence of this invariance seems somewhat artificial; among all 
these possible solutions, only one can be the asymptote of the finite time 
dynamics. At this stage it is an open problem what is the choice which will 
be picked up by the dynamics. 

The ambiguity due to the time reparametrization invariance of the asymp- 
totic equations reflects in the fact that the equations for b u and f u are in- 
dependent of the choice of all the arbitrary functions h u (t). In fact these 
equations are identical to those derived in ED on diverging time scales; this 



set of equations has been shown j33| to possess solutions satisfying the " quasi 
f.d.t." relation: 

U ^L = 2Tf u (r). (38) 

Denoting 6+ = b u (0) and b~ = b u (oo) one has for adjacent domains indexed 
by u < u', b\ = b~,. Within the OED, we find that the dynamical correlations 
are related to the static order parameter function q{u) by the formula 

b-=2{q-q{u)). (39) 

With these ingredients we reproduce the algebra of the static replica solution, 
which gives the value (pTT) for the anomaly. In each domain, apart from the 
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asymptotic one, the variation with r of the functions b u (r) is infinitesimal, 
and q{u) becomes the continuous function given by flip]). 

As we stressed before, this solution can be understood as a reinterpreta- 
tion of the ED solution, and of the static r.s.b. solution. With respect to 
the ED solution, the main advantage is that the diverging time scales have 
been replaced basically by some powers of the waiting time. Unfortunately 
it does not solve the second problem of ED, namely the invariance through 
reparametrizations of time which implies that one looses all the physical 
(crossover) time scales. We stress that this is only a problem of the family of 
solutions that we have introduced. This problem is not intrinsic to the OED 
itself. On the contrary, in the real OED problem there is a unique solution 
to the dynamical equations. This solution might go asymptotically to one of 
the solutions we have presented here (choosing dynamically a set of functions 
h u (t)), or it might even converge to some other asymptote. So far we have 
not been able to answer this problem analytically. So we shall now propose 
some numerical checks which proceed through the numerical solution of the 
dynamical equations. 

The numerical test of this family of solutions might seem hopeless inso- 
far as they depend on an arbitrary set of functions h u (t) which allow for a 
reparametrization of time. We shall call such a set a choice of gauge. In 
order to decide whether the asymptotic solution belongs to our family, we 
propose to use criteria which are gauge independent. One possibility is to 
use some integrated quantities like the "dynamical moments" introduced in 
0: 

C k {t) = k f ds Tr(t, s)C(t, s) k -\ (40) 
Jo 

Within our scenario of hierarchical crossover domains, these moments should 
have a large time limit given by: 

lim C k (t) = q k - f dqP(q)q k . (41) 

Another possibility consists in the introduction of the function: 

at' 

In the crossover regime, where the f.d.t. relation holds, U takes the value 
U(t, t') = 1 at large times, while, in the crossover domain it gives us a 
measure of the violation of f.d.t.. We shall call this function the fluctuation 
dissipation (f.d.) ratio. The gauge invariant prediction of the hierarchical 
crossover domains scenario is that, if one plots the f.d. ratio U as a function 
of the time t along the lines of fixed correlation C, its value at large times is 
equal to u(q), the inverse of the order parameter function. Let us make this 
statement more precise: we first observe that for fixed (and large enough) t, 
C(t,t') is a monotonously increasing function of t'. This allows to define the 
function t'(q,t) as the time if such that C(t,t') = q. The prediction is that: 

U d (q) = lim U(t, t'(q, t)) = u(q) = f dq' P(q') , (43) 

t— >oo Jq 
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which is the inverse of the order parameter function defined in flI5p. We 
have been able to obtain the following general results on the f.d ratio. It is 
easy to show that C(t, 0) = r(t, 0)C(0, 0). Under the reasonable assumption 
lim^oo r(t, 0) = 0, one gets that lim^oo C(t, 0) = 0, and it is easy to deduce 
that lim^oo U (t, t' = 0) = 0. We have seen numerically, but we have not been 
able to prove, that for large enough t, U(t,t') is an increasing function of t' . 
Together with the f.d.t. result in the asymptotic regime lim t _ ! . 00 U(t, t) = 1, 
this shows that U tends to a probability at large times. 

We have tried to use the simple dicretization algorithm described in the 
previous section to study these aging effects (with the same values of h). 
Although we shall see that the times we have reached do not allow to draw 
definitive conclusion on the crossover regimes, we think it is worth to present 
some of the data, in order to see what happens on relatively short times, 
and to give an idea of the type of computing effort which will be needed in 
order to solve this problem. The values of the parameters are 7 = .5,6 = 
5., \i = .125, T = .5, C(0, 0) = 0. We have checked that the errors due to the 
discretisation and interpolation procedures are negligible on the scales of the 
figures. 

We first present some confirmation of the existence of the aging effect. In 
Fig. 5 we plot the "thermoremanent magnetization" which we define as: 

M(r,t w ) = / dsr(t w + r,s) (44) 
Jo 

The plot shows M.{r,t w ) versus r for fixed values of the waiting time t w , 
on logarithmic scales. On these time scales, one clearly sees an aging effect 
which is qualitatively similar to the one observed in experiments @, |, [7| 



and numerical simulations [|39], [18], [19| in spin glasses. The effect is confirmed 
in Fig. 6 which plots the normalised correlation C(t w +r, t w )/C(t w ,t w ) versus 
r, at fixed t w . We have observed that the curves do not scale very well as 
functions of r/t w . 

We have tried to test the hierarchical solution by some studies of gauge 
invariant quantities. We first study the dynamical moments (§3). The first 
moment C\ satisfies a kind of Ward identity (related to the translational 
invariance of the distribution of the random potential): 

r(t,0) = l-^C 1 (t). (45) 

(a simple proof consists in showing that the two sides of this equality sat- 
isfy the same first order differential equation in time, with the same ini- 
tial condition). As r(t, 0) should vanish at large times, this implies that 
firn t _ >0O Ci(i) — T/fj, — q — J dqP(q)q. Numerically we have checked that the 
Ward identity (|4"5[ ) is satisfied with a precision of 10~ 5 , and that the behaviour 
of r(t, 0) is consistent with a decay to zero. We have computed numerically 
the first five moments Ck(t), k — 1, 5. In Fig. 7 we plot the third moment 
versus time. Within the hierarchical scenario one would expect that its large 
time limit should be given by the third moment of the static P(q) as in (|4l| ). 
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which is equal to 9011 in our case. The inset of Fig. 7 shows that the rela- 
tive difference of C 3 (t) with this value decays approximately as a power law. 
However at t ~ 800 the relative difference is still of order 10 per cent. Fig. 8 
shows the fifth moment and its approach to the static value 5.76 10 6 . We 
consider this data as compatible with the hierarchical scenario but not really 
conclusive. As explained above, a more detailed analysis of the data consists 
in studying the f.d. ratio fl42[) and to test the prediction (|43|). In Fig. 9 we 
plot C(t,t')/C(t,t) versus the time t, along lines in the t',t plane such that 
U(t,t') is constant, equal to u . According to the hierarchical scenario, this 
quantity should go at large t to q(uo)/q defined in (|15"D. On this time scale, 
we do not see evidence for such a convergence. To summarize, we consider 
the results on the moments as encouraging, but the detailed analysis on the 
f.d. ratio shows that simulations on much longer time scales are needed in 
order to decide on the correctness of the hierarchical solution. 



Conclusions 

In this paper we have studied the off equilibrium dynamics of a disordered 
model which represents on one hand a limiting case of a manifold in a ran- 
dom environment, on the other hand a spin glass with long range interac- 
tions. The choice of this model has several motivations. Its static solution 
at low temperatures implies a full continuous r.s.b., as for instance in the SK 
model; this r.s.b. solution is known in all details. On the other hand, we can 
write a closed set of coupled dynamical equations between the correlation 
and response. Because of this, we have been able to generalize the analytic 



solution of |17j in the aging regime of the spherical p-spin model to a full 
r.s.b. case and to compare to a numerical integration of the equations. Si- 
multaneously to our work, Cugiandolo and Kurchan have also extended their 



analytic solution to the SK model close to T c B7 



Our analysis is consistent with the existence of two regimes at large times 
in the low temperature phase: an asymptotic regime where time homogeneity 
and fluctuation dissipation relations hold, and an aging regime where both 
these properties are violated. These regimes are similar to the ones observed 
in experiments and simulations. We have found convincing numerical evi- 
dence that the asymptotic regime agrees with the static r.s.b. results and 
with the ED results. The correlations are those characteristic of a system 
reaching equilibrium inside one single valley. We have shown that these facts 
imply the existence of a non trivial aging regime. 

We have proposed a family of solutions of the dynamics at large time in 
this aging regime, based on a hierarchy of crossover domains. This solutions 
solve the problem of the diverging time scales which had to be introduced in 
ED. On the other hand several problems are left open. We have not been able 
to show that the dynamics converges to one of these solutions, and a fortiori 
we do not know which of them is picked up. This choice might well depend 
on the choice of the Langevin dynamics and of the type of initial conditions 
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which are used. We have found that the f.d. ratio tends to a probability 
law at large times. Longer simulations are needed to decide whether this 
probability law is identical to the static u(q), as implied by the hierarchical 
scenario. At the present stage, we believe that it is crucial to carry out this 
numerical study. The physical interpretation of the dynamical probability is 
also a very important open question. 

It would be interesting to generalize this approach to systems driven by 
an external force (charge density waves, vortex lattices,...), and to study more 
subtle effects like those of temperature cycling. We would also like to point 
out that this route of OED seems to be a promising one towards a rigorous 
study of spin glasses. One should first obtain a rigorous derivation of the 
dynamical equations, and then understand the large time behaviour of these 
equations. This is certainly not easy, but it is a well defined mathematical 
problem and our work suggests that these coupled dynamical equations con- 
tain in some sense the full r.s.b. solution. A first step towards a rigorous 
derivation of the dynamical equations has been taken recently for the SK 
model EOf 
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Appendix A 

In this appendix we sketch the derivation of the mean field dynamical equa- 
tions fliDD for the toy-model by the cavity method |l|]. This method provides 
the same results as the functional derivation of [02 |. We include a brief de- 



scription here because it is maybe more explicit on the physical content of 
the derivation. Apart from unessential complications, the derivation could 
be done similarly for the more general equations (0J^Q) for finite D. The 
method involves an induction over the number dimensions N of the space in 
which the particle lives, together with a large limit. We pass from a N 
dimensional system described by <p — {4>ii •••■>4>n} to a N + 1 dimensional 
one described by </>, plus a new component <pQ. In the derivation we follow 
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a procedure analogous to that which has been used e.g. to study the statics 
and the equilibrium dynamics of the SK model. We will make crucial use of 
two hypotheses that mutatis mutandis habe been put forward in that case. 
Namely, the applicability of the linear response theory fort the Langevin 
equation (LRT), and the fact that the responses 8<fi a (i)/5r}p(s) can be con- 
sidered small (in a suitable sense) for a 7^ f3. A justification of these in the 
case of equilibrium dynamics is given in [|TJ. For OED, we just assume these 
two facts. It will be interesting to see if similar assumptions are contained 
in the functional approach, or whether these facts can be derived. 
Consider the Langevin equation for the toy-model: 

d<p a (t) _ dHMt)) 

dt - d<p a +Va[t) 

(Va(t)vp(s)) = 2T5 a(3 5(t-s). (46) 

If an infinitesimal perturbation 5H{4>) is added to H, the perturbed process 
4>*{t) can be expressed in terms of the unperturbed one <f>(t) by the linear 
response relation: 

y Jo d<f)p orjp{s) 

Let us now introduce the new component, and denote by Vjy(0) and 
Vn + i(4>o, <f>) the random potentials for the N and N + 1 components systems 
respectively. In making this step, the Hamiltonian H = yU0 2 /2 + Vat(0) will 
undergo the variation 

6H((f> , 4>) = (J41/2 + 6V(<f> ,<f>) 
5V(<t> , <t>) = V N+1 (<f> , <f>) - V N ((j>). (48) 

The <p* a and <p a in fl4"7j) have to be identified with the a-th component of the 
position of the particle respectively in presence and in absence of 0q. 

To study the statistical properties of SV we can expand in series the 
correlations of the potential of the N + 1 components system 

\2 



[(0 - </0 2 + (<h - M 2 } 



W0o,</>)W^o, V>) = ~(N + 1)/ (V + i) J ' (49) 

and retain only the terms of the series which do not tend to zero when 
N -> 00. 

In this way we find: 

%i)%,^)= - {/((0-VO7AO- (0 ~^ )2 /W-^) 2 /^) 

+ (0o -W 2 /'((^-^) 2 /iV)} (50) 



19 



These formulas can be obtained expanding formally Vn+i(4>o,4>) in powers 
of 4>o up to the second order. In this way, denoting b = (</> — t/>) 2 /iV, one 
easily shows that 8V((j)o, <f>) can be written as 

8V(4> , 4>) = A{cf>) + 5(0)0 O + D{cj>)<j)l (51) 

where A, B and D are gaussian random functions with zero averages and 
correlations: 



A((J>)A&) 


-[/(&) " 


A{<t>)B{^) 


= 0(1/N) 


A{4>)D{il>) 


= -fiP) 


B(<t>)B(iP) 


= 2f'(b) 


B(<t>)D(i/>) 


= 0(1/N) 


D(<t>)D{il>) 


= 0(1/N) 



(52) 

We can now write the Langevin equation for the zeroth component fa 



dt 

Using the LRT we find 



fifa - B(cf>*(t)) - 2D(cf>*(t))Mt) + Vo(t). (53) 



^ [A(cf>(s)) + B(0( 8 ))0o W + D(<f>(s))<f> 2 (s)] 

D{<t>*{t)) =D{4>{t))-tids £ Q/3 dD $W g;gj 

gf- [A(0(a)) + B(<t>(s))Ms) + £>(0(s))0g(s)] • (54) 



At this point we use the hypothesis that 8(j) a {t)/8r]p{s) is small for a (3. 
More precisely we suppose that as in the SK mode ^lN 2 Y,a.p84> a (t)/8'qp(s) 
and analogous sums will tend to zero in the large N limit. One deduces that 



( |54|) reads in this limit: 



B(0*(t)) = B(cj>(t))- ds4,f"{b(t,s))r{t,s)U^ 

Jo 

D{4?{t)) = D{<t>{t))- [ t ds2f"(b(t,s))r(t,s). (55) 

*/ 

where b(t, s) = (<f>(t) - <f>(s)) 2 /N and r(t, s) = (l/N) E a Wa(t)/^(s))- 

Denoting m(t, s) = 4f"(b(t, s))r(t, s) and making use of (|55D the Langevin 
equation ( |53| ) is rewritten as 

(H,(/) - -/i0o(t)- J B(0(t))-2D(0(t))0 o (t)+f dsm(t,s)[0 o (t)-0o(s)]+r7o(t). 

(56) 



dt Jo 
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(In deriving ( 5B ) we have dropped a term proportional to D(<fi(t))(j)o{t) 
which is negligible because of the vanishing correlations (^) of D at large 
N.) The term B(<fi(t)) is a random field with zero mean and correlations 
B((f>(t))B(<f>(t)) = 2f(b(t, s)) = w{t, s). Therefore equation (H) is the usual 
Langevin equation on one single component, with a condition of selfconsis- 
tence, from which the dynamical equations are easily derived. We just notice 
that this derivation shows a property of self averageness of the response, 
namely the fact that the response function of each component is identical: 
r(t,s) =< 50 o (t)/%(s) > 
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Figure Captions 



Fig. 1: a) An estimate of the large time limit , Coo, of the autocorrelation 
C(t,t), from the numerical solution of the dynamical equations with a 
grid size h = 1.2. The derivative dC(t,t)/dt has been fitted to a power 
law with logarithmic corrections (see text). For each time t, is 
approximated by C (t, t) plus the integral of the fit of the derivative. 
The plot gives this estimation, versus the time t. The analytical result 
from r.s.b., Coo = 21.5, is compatible with the result, when one takes 
into account the effects due to the finite value of h (see Fig. lb) and to 
the uncertainties of the fit. b) The difference between C(t, t) computed 
with a grid size h = 1.2 and that computed with h = .8, plotted versus 
time in a Log-Log plot. This difference seems to extrapolate to zero at 
large times (with a power law behaviour). 

Fig. 2: a) An estimate of the large time limit , E^, of the energy E(t), 
from the numerical solution of the dynamical equations with a grid size 
h — 1.2. The procedure is the same as that followed for the estimate 
of C(t,t) in Fig.l. The analytic result from r.s.b., = —1.3660, is 
compatible with this data when one takes into account the effect of the 
extrapolation to h — (see Fig. 2b, and the text). b)The difference 
between E(t) computed with a grid size h = 1.2 and that computed 
with h = .8, plotted versus time. This difference is well approximated 
by a power law fit with an asymptote equal to .0116. 

Fig. 3: The quantities A (t) (continuous line) and B(t) (dotted line) defined 
in the text in a Log-Log scale. A(t) is better approximated by a power 
law then B(t). A pure power law fit on the last 300 points over a total 
of 890 gives A(t) = .04 + 14.8 t~' 57 with a relative error on the whole 
interval of the order A A/ A ~ 10~ 6 and B(t) = .29 + 35.1 t~' 57 with 
AB/B ~ 10" 5 . 

Fig. 4: In a), the response r(t w + r,t w ) versus r. From top to bottom, 
t w = 432, 504, 576, 648. Also shown (bottom curve) is the power law 
extrapolation of these curves to t w — > oo, together with the predic- 
tion for r as (r) from the asymptotic dynamics (these last two curves 
are nearly undistinguishable). In b), similar curves for the corrrela- 
tion b(t w + r,t w ). From top to bottom, t w = 432,504,576,648, the 
extrapolation and the expected result from the asymptotic dynamics. 

Fig. 5: The thermoremanent magnetization A4(r, t w ) defined in ([H]) versus 
r for fixed values of the waiting time t w , on logarithmic scales. From 
bottom to top, t w =38.4, 76.8, 153.6, 307.2, 614.4. 

Fig. 6: The normalised correlation C(t w + r,t w )/C{t w ,t w ) versus r, for 
fixed values of the waiting time t w . From bottom to top, t w =38.4, 
76.8, 153.6, 307.2, 614.4. 
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Fig. 7: The third dynamical moment C${t), defined in ( |4"0"| ) versus t. The 
inset is a log-log plot of the relative difference between the moment at 
time t and the prediction from the scenario of hierarchical crossovers 
concerning its large time behaviour: (9011 — Cs(t))/9011 versus t. 

Fig. 8: The same plot as in Fig. 7, for the fifth dynamical moment versus 
time, and its convergence to the theoretical result 5.76 10 6 . 

Fig. 9: The function C(t,t')/C(t,t) versus the time t, along lines in the 
t, t' plane such that the f.d. ratio U(t,t') is constant, equal to u . 
From bottom to top, Mo = .1, .2, .9. If the scenario of hierarchical 
crossovers would hold, at infinite t the curves with uO < .375 should 
extrapolate to .744, the ones with w > -411 should extrapolate to .859. 
There is no such indication on this time scale. 
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